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Abstract — We derive new upper and lower bounds on the 
fading number of multiple-input single-output (MISO) fading 
channels of general (not necessarily Gaussian) regular law with 
spatial and temporal memory. The fading number is the second 
term, after the double-logarithmic term, of the high signal-to- 
noise ratio (SNR) expansion of channel capacity. 

In case of an isotropically distributed fading vector it is proven 
that the upper and lower bound coincide, i.e., the general MISO 
fading number with memory is known precisely. 

The upper and lower bounds show that a type of beam-forming 
is asymptotically optimal. 

Keywords: Beam-forming, channel capacity, fading, fading 
number, high SNR, memory, MISO, multiple-antenna. 

I. Introduction 

It has been recently shown in [1], [2] that, whenever the 
matrix-valued fading process is of finite differential entropy 
rate, the capacity of multiple-input multiple-output (MIMO) 
fading channels typically grows only double-logarithmically 
in the signal-to-noise ratio (SNR). To quantify the rates at 
which this poor power efficiency begins, [1], [2] introduced the 
fading number as the second term in the high-SNR asymptotic 
expansion of channel capacity. Explicit expressions for the 
fading number were then given for a number of fading models. 
For channels with memory, the fading number of single-input 
single-output (SISO) fading channels was derived in [1], [2] 
and the single-input multiple-output (SIMO) case was derived 
in [3], [4], [2]. 

The fading number of the multiple-input single-output 
(MISO) fading channel has been derived in general only for 
the memoryless case [1], [2]: 

X(H T )= sup {log7r + E[log|H T x| 2 ] -/i(H T x)} . (1) 

11*11=1 

This fading number is achievable by inputs that can be 
expressed as the product of a constant unit vector in C" T and 
a circularly symmetric, scalar, complex random variable of the 
same law that achieves the memoryless SISO fading number 
[1]. Hence, the asymptotic capacity of a MISO fading channel 
is achieved by beam-forming where the beam-direction is 
chosen not to maximize the SNR, but the fading number. 

In [5] and [6] Koch & Lapidoth investigate the fading 
number of MISO fading channels with memory where the 
fading is Gaussian. For the case of a mean-d Gaussian vector 
process with memory where {H^. — d} is spatially independent 



and identically distributed (IID) and where each component 
is a zero-mean unit-variance circularly symmetric complex 
Gaussian process, the fading number is shown to be 1 



XGauss, spat. IID ({H T fe }) 
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where e 2 denotes the prediction error when predicting one of 
the components of the fading vector based on the observation 
of its past. 

Furthermore, Koch & Lapidoth derive an upper bound to the 
fading number for the general Gaussian case, i.e., {H^ — d} 
is a zero-mean circularly symmetric stationary ergodic com- 
plex Gaussian process with matrix-valued spectral distribution 
function F(-) and with covariance matrix K. Assuming that the 
prediction error covariance matrix Y. is non-singular (regularity 
assumption) they show that 



XGauss({H T fc }) < -1 + logd 2 - Ei(-dl 



log- 



I K I 



where 



||*||=i ^Var(H T fc x) 



(3) 



(4) 



Amin denotes the smallest eigenvalue of Z; and where || • | 
denotes the Euclidean operator norm of matrices, i.e., the 
largest singular value. 

In this paper we extend these results to general (not neces- 
sarily Gaussian) fading channels. 

The remaining of this paper is structured as follows: after 
defining the channel model in detail in the following section, 
we will present the main results, i.e., a new upper and lower 
bound on the MISO fading number, in Section ITTTI 

We then specialize these results to the case of isotropically 
distributed fading processes in Section IIVI and to Gaussian 
fading in Section [V] For isotropically distributed fading we 
will show that the upper and lower bound coincide. In the 
Gaussian case we shall derive the above mentioned results of 
Koch & Lapidoth as special cases of our bounds. 

We conclude in Section [VTI 

'Note that all results in this paper are in nats. 



II. The Channel Model 

We consider a MISO fading channel whose time-fc output 
Y?c € C is given by 

Y k = H T fc x fc + Z k (5) 

where x^ 6 C" T denotes the time-fc channel input vector; 
where the random vector denotes the time-fc fading vector; 
where H J k denotes the transpose of the vector H^; and where 
Zk denotes additive noise. Here C denotes the complex field, 
C" T denotes the nx-dimensional complex Euclidean space, and 
nj is the number of transmit antennas. We assume that the 
additive noise is an IID zero-mean white Gaussian process of 
variance a 2 > 0. 

As for the multi-variate fading process {H^,}, we shall only 
assume that it is stationary, ergodic, of finite second moment 



E[||H fc || 2 ] <oo, 
and of finite differential entropy rate 

h({H k }) > -oo. 



(6) 



(7) 



Finally, we assume that the fading process {H^} and the 
additive noise process {Zk} are independent and of a joint 
law that does not depend on the channel input {x^}. 

As for the input, we consider two different constraints: a 
peak-power constraint and an average-power constraint. We 
use £ to denote the maximal allowed instantaneous power in 
the former case, and to denote the allowed average power in 
the latter case. For both cases we set 



SNR 4 L, 



The capacity C(SNR) of the channel (|5} is given by 



C(SNR)= lim -sup/(X";F 1 rl ) 

n— »oc 77, 



(8) 



(9) 



where we use X^ to denote Xj , . . . , X^ and where the 
supremum is over the set of all probability distributions on 
X™ satisfying the constraints, i.e., 

|Xfe|| 2 < £, almost surely, k — 1,2, ... ,n 



for a peak constraint, or 

^±E[\\X k \\ 2 ]<£ 



(10) 



(11) 



fe=l 

for an average constraint. 

Specializing [1, Theorem 4.2] or [2, Theorem 6.10], respec- 
tively, to MISO fading, we have 



lim (C(SNR) - log log SNR ) 



SNR| 



< OO. 



(12) 



The fading number \ is now defined as in [1, Definition 4.6] 
and in [2, Definition 6.13] by 

x({H T fc })^ HE fc(SNR)-loglogSNR}. (13) 

Prima facie the fading number depends on whether a peak- 
power constraint dlOt or an average-power constraint M \\ is 



imposed on the input. Since a peak-power constraint is more 
stringent than an average-power constraint, we will derive 
the upper bound using the average-power constraint and the 
lower bound using the peak-power constraint. In case of an 
isotropically distributed fading process we shall see that both 
constraints lead to identical fading numbers. 

III. Main Results 

We first state a new upper bound to the fading number of 
a MISO fading channel: 

Theorem 1: Consider a MISO fading channel with memory 
(Q where the stationary and ergodic fading process {H^.} 
takes value in C" T and satisfies h({H.k}) > — oo and 
E[||Hj.|| 2 ] < oo. Then, irrespective of whether a peak-power 
constraint dlOi or an average-power constraint (II It is imposed 
on the input, the fading number x({H~[,}) is upper-bounded 
by 

X ({H T fc }) < sup { logvr + E[log |H T x | 2 ] 

-^(H T x |{H T ,x,}7i_j} (14) 
where x< = u^rr denotes a vector of unit length. 

t ||x f || 6 

Proof: The proof is in part pretty technical. We therefore 
give only an outline and omit the details. 

Similar to the derivation of the SIMO fading number with 
memory, the proof starts with a lemma that limits the possible 
joint input distributions on Xi , . . . , X„ to such under which 
each random vector X^ has the same law with an average 
power equal to the constraint £. Unfortunately, the proof is 
complicated by the fact that this lemma does not guarantee 
equal marginals for the time epochs fc on the border of a 
block. However, these edge effects wash out once we let the 
blocklength n tend to infinity. 

The proof then proceeds as follows: the mutual information 
between joint input and joint output is split up into a term 
describing the memoryless case and a term that takes care of 
the memory: 

lim i/(X?;l?) 

n — >oo fi 



1 

< lim - V(/(X fe ;Y fc ) 



fc=l 



+ /(H T fe X fc ;{HJX £ }ti|^)j, (15) 

where the above mentioned lemma guarantees an input distri- 
bution with equal marginals and an average power of £. 
The first term is then upper-bounded by 



^(Xfe; Yk) ^ E± k C SIS0 jjjj #_ H T£ fc {£ ) 



(16) 



where the approximation results from ignoring some additional 
terms that tend to zero as £ tends to infinity. We hence get a 



bound 

C p2 ^X"^ ^SISO,IID,_ff=HjX ) 

+ 7(H T X ; {HjXa^i-oo | {X, = x, }?=-«,)] ( 17 > 
< sup {c SISO>nD>H=H T &0 (f) +/(h;x ;{HJx £ }7 = 1 _ oo | 

(18) 

where the approximation results from ignoring the edge effects 
and the terms that will tend to zero as £ tends to infinity. 

The claim now follows by using the fading number of a 
memoryless SISO fading channel. ■ 

Next we state a lower bound to the fading number of a 
MISO fading channel: 

Theorem 2: Consider a MISO fading channel with memory 
l|5) where the stationary and ergodic fading process {H^} 
takes value in C" T and satisfies h({H k }) > — oo and 
E [||Hfc|| 2 ] < oo. Then the fading number x({H^.}) is lower- 
bounded by 

X ({H T fc }) > sup { logTr + E [log |H T x| 2 ] 

-h(Ulk\{U}±}^_j] (19) 

where x = denotes a vector of unit length. 

11=11 6 
Moreover, this lower bound is achievable by IID inputs that 

can be expressed as the product of a constant unit vector x G 

C" T and a circularly symmetric, scalar, complex IID random 

process {X k } such that 



log|X fe | 2 ~W([loglog£,log£:] 



(20) 



Note that this input satisfies the peak-power constraint dlOt 
(and therefore also the average-power constraint il 

Proof: We only give an outline of the proof. The details 
are omitted. 

The lower bound is based on the assumption of a specific 
input distribution which is chosen to be of the form 



X k -x 



(21) 



where x is a deterministic unit vector (the beam-direction) and 
where {Xk} is IID circularly symmetric with 



log|X fe | 2 ~W([loglog£,log£:] 



(22) 



Note that this choice for {Xk} achieves the fading number for 
the SISO fading channel 



Y k = (H[.x) • X k + Z k 



(23) 



with fading process {H k } = {H^x}. The lower bound is then 
derived by proving 



1 1 - 

-7(X?;17) « - £ j(X fc ; Y^Hlx}*^ 1 ) 

r? r? ^ — ' v 1 



(24) 



fc=i 



and using the results of memoryless SISO fading channels 
with side-information [1], [2]. ■ 



IV. Special Case of Isotropically Distributed 
Fading 

We next consider the special case of isotropically distributed 
fading processes, i.e., for every deterministic unitary nj x nj 
matrix U 

H, i UH fc , (25) 

where we use =" to denote equal in law. 
In this case we have the following corollary: 
Corollary 3: Consider a MISO fading channel with mem- 
ory (|5} where the stationary and ergodic fading process 
{Hfe} takes value in C" T , satisfies h({H. k }) > —oo and 
E[||Hfe|| 2 ] < oo, and is isotropically distributed. Then the 
upper bound (114-i and the lower bound d!9l > coincide and the 
fading number Xiso({H^.}) is given by 



XlS0 ({H T fc }) =lo g7 r + E[log|H T e| 2 ] 
- ^(H T e | {H5e}^_„ 



(26) 



where e is any deterministic unit vector. 

Proof: This follows immediately from Theorem [2 and |2| 
by noting that for any e 



H^e = U T k U T e = H[.e' 



(27) 



where the first equality in law follows from (1251 and the 
second equality by defining a new unit vector e' = U T e. Note 
that for the MISO case isotropically distributed is equivalent 
to rotation commutative in the generalized sense as defined in 
[1, Defintion 4.37] or [2, Defintion 6.37]. ■ 

V. Special Case of Gaussian Fading 

In this section we assume that the fading process {H^} is 
a mean-d Gaussian process such that {H- k } = {H k — d} is 
a zero-mean, circularly symmetric, stationary, ergodic, com- 
plex Gaussian process with matrix-valued spectral distribution 
function F(-), and with covariance matrix K. Furthermore, we 
assume that the prediction error covariance matrix Z is non- 
singular (regularity assumption). 

A. Upper Bound for Gaussian Fading 

We start with a new derivation of the upper bound based 
on Theorem^ We will see that l|3} is in general less tight than 

We start by loosening the upper bound dl4> as follows: 
X({H T J) 

< sup (lo g7 r+ E[log|H;x | 2 ] 

-^xolMxa^j} (28) 
= sup {logvr+ E[log|H;x | 2 ] - h(H J x ) 

+ ^(H T x ) - Ji(H5*o | {H3fc}7i-J} (29) 

< sup { log it + E [log |HqX | 2 ] - h (H T x ) } 



+ 



sup {^(H T i ) - /i(H T x | {Hjx*}^_ J } (30) 

sup | log 7r + E [log |H T x | 2 ] - h(H T Q k Q ) } 
+ sup /(H T x ; {Hjxa^i-oo). 



where (I30i follows from 

sup{/(a;) + 5(3;)} < sup f(x) + supg(x). 



(31) 



(32) 



In [1, Corollary 4.28], [2, Corollary 6.28] it has been shown 
that the IID MISO fading number Q for Gaussian fading is 
given by 

X (H T )= sup {log7r + E[log|H T x| 2 ] -/i(H T x)} (33) 

ll*ll=i 

logd 2 -Ei(-d 2 ) (34) 



-1 



where d* is given in (0}. This proves the equivalence of the 
first supremum in i31\ with the first three terms of (|3}. It 
therefore only remains to prove that 

sup /(H x ; {H^j^J < log M. (35) 

x° ^min 

To this goal note that 

sup /(Hjjxo; {Hjx^}7 = 1 _ oo ) 

< sup 7(H T x ; {U^j-^HZI) 

= sup/(Hjx ;HZ^) 

x 

= sup {/i(H T x ) - ft(H T x | HlL) } 
= sup {log (TrexjKxo) - h(H T x Q | HI^) } . (39) 

Here, the first inequality follows from the inclusion of addi- 
tional random variables in the mutual information; the subse- 
quent equality from the fact that given the past realization of 
the fading, HqXo is independent of {HIx^}7; _ ; and in the 
last equality we have used the expression for the differential 
entropy of a Gaussian random variable with K denoting the 
covariance matrix of {Hfe}. 

Note that the first inequality in general is not tight, i.e., l|3} 
is in general looser than J3 11 which in turn is in general looser 
than (flU. 

To compute the second term on the RHS of d39l . we express 
the fading Hq as 



(36) 
(37) 
(38) 



H = H + H 

with Ho being the best estimate of Ho based on the past 
realizations. We note that Ho ~ A/c(0,Z) where Z denotes 
the prediction error covariance matrix. Hence 

/i(Hjx | Hzle) = log (TrexJZxo 



The bound (1351 now follows by the Rayleigh-Ritz Theorem 
[7, Theorem 4.2.2], [2, Theorem A.9] 



^min — 



(42) 



the definition of the Euclidean norm of matrices, and the 
properties of positive semi-definite matrices: 

maxx t Kx = m_axx t S T Sx = max ||Sx|| 2 = ||S|| 2 = ||Kj|. 

XX X 

(43) 

B. Spatially IID Gaussian Fading 

We next specialize the assumptions to the case where 
{Hfe} = {Hfe — d} is a spatially IID process where each 
component is a zero-mean unit-variance circularly symmetric 
complex Gaussian process of spectral distribution function 
F(-). For this case we will now present a new derivation of 
the result (0 based on our new bounds. 

Note that we cannot apply Corollary [3] here: even though 
{Hfe} is isotropically distributed, {Hfe} is not due to its mean 
vector d. 

However, the term /(HqXo! {HJx^}^_ 00 ) does not de- 
pend on the particular choice of 5q: 

/(HSxoKHJMZi-oo) 

= 7(H T xo - d T x ; {H^x, - d T x^i_ J (44) 



7(H xo;{H T ,x,}7 = 1 _ c 
/(H T e;{Hje}7i_J 
I(H^;{H^}-} 

lo S72- 



i=-oo> 



(45) 
(46) 
(47) 

(48) 



Equation (0 now follows from ( I34> . Theorem ^ and Theo- 
rem |2] by noting that 



E \H J 1 xl 

max 1 fcJ 1 = max |d T x| = lldll, (49) 

11*11=1 VVar(H£x) 11*11=1 

where the maximum is achieved for x = d/||d||. 

VI. Discussion & Conclusion 

We have derived two bounds for a MISO fading channel of 
general law including memory. Both bounds show the same 
structure involving the maximization of a deterministic beam- 
direction x, which suggests that beam-forming is optimal at 
high SNR. However, one has to be aware that the beam- 
direction is not chosen to maximize the SNR, but to maximize 
the fading number. 

The differences between the upper and lower bound lies in 
the details of the maximization: while in the lower bound one 
single direction unit vector x is chosen for all time, the upper 

(40) bound allows for different realizations of Xfe for different times 
k. 

We are convinced that the lower bound is actually tight: 
intuition tells that for our stationary channel model a stationary 
input should be sufficient for achieving the capacity. As a 
matter of fact in the SISO and SIMO case it has been shown 

(41) that actually an IID input suffices to achieve capacity at high 



SNR [1], [2], [4]. Furthermore, we have been able to modify 
the derivation of the upper bound such as to get the following 
bound: 



x({H T fc }) 

< sup E-£ 

Qx x„^* " 









log 7T + E 


HqX 


X 



^( H o x o I {HpQ}^ = _ re , {X £ - :>q}" = _ k ) 



(50) 



Here, k is an arbitrary (large) positive integer, and V* denotes 
the set of all joint distributions on X_ K , . . . , Xo where 

\\±e\\ = 1 a.s. (51) 

and where each X^ has the same distribution, for all £ — 
— k, . . . , 0. This bound can easily be loosened to get the result 
of Theorem [2 one simply upper-bounds the supremum over 
Q with a supremum over x°_ K . However, it intuitively seems 
that under the constraint that all marginals of Q must be the 
same this bound is not tight. 

In the case of isotropically distributed fading the particular 
choice of direction has no influence on the fading process and 
therefore the upper and lower bounds coincide. 

In the case of Gaussian fading we could show that the 
bounds presented in [5] and [6] are special cases of the new 
bounds presented here, where the new upper bound dl4> is in 
general tighter than 

The success of further attempts on deriving the MISO fading 
number precisely will be crucial to the investigation of the 
fading number of general MIMO fading channels. 
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